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is claimed is: 

A method to calculate an element R(x,y) of a viewpoint-independent spatial covariance 
matrix of a given object in a database for infinitely dense sampling of illumination 
conditions, the method comprising: 

calculating E(u x ,u y ,c), an integral over all possible light directions, weighted by their 

respective intensities, according to the equation: 

E(u X9 u y9 c)=\ L(n)D(n,p,q) 

where weS 2 is a particular direction on the unit sphere, S 2 , where L is the light 
intensity and n is a normal vector on the unit sphere S , where u x and u y are the unit 
vectors of the special coordinate system defined by p and q, where p and q are vectors 
in which the x-axis is the bisector of the angle, 29, between them, where p = (c,+s,0) 
and q = (c,-s,0), where c = cos9, s = sinG, and (x,y) is the image point; 
solving for the viewpoint-independent spatial covariance matrix R(x,y) according to 
the equation: 

R(x,y) = a{xp.{y)E(u x ,u y ,c) 

where oc(x) is the intrinsic reflectance at the image point x and ot(y) is the intrinsic 
reflectance at the image point y; and 

tabulating and storing the result of said viewpoint-independent spatial covariance 
matrix R(x,y). 

A method to calculate an element R(x,y) of a viewpoint-independent spatial covariance 
matrix of a given object where there is no preferred direction in the illumination, the 
method comprising: 
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calculating E(c(p(x),q(y))), according to the equation: 
E(c) = { 2 t c 2 n 2 x -(\-c 2 )n 2 

where ne S 2 is a particular direction on the unit sphere, S 2 , where C(n,c) is the joint- 
visibility condition, where n is the given direction, where p and q are vectors in which 
the x-axis is the bisector of the angle, 20, between them, where p = (c,+s,0) and q = 
(c,-5,0), where c = cosG, s = sinG, and (x,y) is the image point; 
solving for the viewpoint-independent spatial covariance matrix R(x,y) according to 
the equation: 

R(x,y) =a(xMy)E(c(p(x),q(y))) 
where a(x) is the intrinsic reflectance at the image point x and a(y) is the intrinsic 
reflectance at the image point y; and 

tabulating and storing the result of said viewpoint-independent spatial covariance 

matrix R(x,y). 
The method of claim 2, comprising: 

using the Monte Carlo procedure to evaluate the integral for E(c) in claim 2. 
A method for finding a set of Q pairs of reference values for the albedo and normals, 
such that the perturbations are smallest for a given value of Q, the method 

comprising: 

using vector quantization algorithms to cluster a set of vectors 
{(a(x)> jK x ))Lek together in Q clusters; 

finding the centroids {(pc^ >q)\ qeQ of said clusters such that the average distance from 
the vectors to the nearest respective cluster-centroid, q(x)=q x , is minimal, where & q 
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t * 

is a reference albedo to an albedo ct(x), q is a reference normal close to a vector 

normal to the surface, p(x), and x is a point on the surface of an object; and 

storing the results. 
The method of claim 4, comprising: 

using a Linde-Buzo-Gray algorithm as said vector quantization algorithm. 
The method of claim 4, comprising: 

using a Deterministic Annealing algorithm as said vector quantization algorithm. 
A method to generate a low-dimensional basis of the viewpoint-dependent illumination 
subspace from the pre-computed viewpoint-independent hierarchy of eigen-surfaces, the 
method comprising: 

generating and diagonalizing said object's vector-quantized viewpoint-independent 
covariance matrix R Q ; 

determining the eigenbasis hierarchy defined on the surface of the object from the 
results of R Q , using the equation: 

*(^v)~|>>)G> r (v) 

where Q is the desired complexity, where o r 2 is the non-increasing eigenspectrum of 
the spatial and the temporal covariance matrices, where \|/ r (w) and \|/ r (v) are the 
respective orthonormal eigenvectors of said spatial and temporal covariance matrices, 
and (w,v) is a point on the surface of the object; 

choosing a cutoff, N 9 such that the average residual signal power, trR N , is between the 
values of 0.1 - 10; 

keeping only the first iVeigensurfaces and storing the results for subsequent use; 
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warping said stored N eigensurfaces to a basis of the viewpoint-dependent 
illumination subspace at the viewpoint-dependent stage using the equation: 


when a query at a particular viewpoint needs to be matched to the objects in said 
database; and 
storing the results. 

8. The method of claim 7, further comprising the step of finding M, the final dimensionality 
of the viewpoint-dependent eigen-subspace, the method comprising: 

warping a viewpoint dependent, non-eigen-subspace of dimensionality N from a 
viewpoint independent eigen-subspace of dimensionality N; and 
finding the leading M-dimensional viewpoint dependent eigen-subspace of the Tri- 
dimensional viewpoint dependent non-eigen-subspace resulting from said warp, 
according to the equation: 


V,(*)=Vr (*(")) 


M _ 


where 


N 


where c P and U are determined by the eigenvalue decomposition of an NxN 


matrix B re where 



X 


9. The method of claim 8, comprising: 
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the final dimensionality of the viewpoint dependent subspace, M, having a value up 
to 20. 

The method of claim 9, comprising: 

the final dimensionality of the viewpoint dependent subspace, M, having a value 

between 4 and 9, inclusive. 
The method of claim 8, comprising: 

having the value of N not less than 2 times the value of M, and not more than 8 times 

the value of M. 
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